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METHOD AND SYSTEM FOR MULTIMODAL PRESENCE DETECTION 



CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is a continuation of application 
5 number 09/990,760, filed November 16, 2001, which is 

incorporated by reference herein. Also, this application 
relates to the application entitled "METHOD AND SYSTEM 
FOR INTELLIGENT ROUTING BASED ON PRESENCE DETECTION", 
U.S. patent application serial no. 09/990,761, filed 
10 November 16, 2001, whose disclosure is hereby 

incorporated by reference into the disclosure of the 
present appl icat ion . 

TECHNICAL FIELD 

15 The present invention relates to methods and systems 

for presence detection. 



BACKGROUND OF THE INVENTION 
Presence management refers to the task of 

20 identifying whether a given user is available to receive 
a communication. The concept originated, at least in 
part, in instant messaging products such as those 
provided by AOL, Yahoo and MSN. In a typical scenario, a 
user's availability or presence is registered into an 

25 application-specific database in response to the user 
logging in to a particular software application. When 
other users wish to contact the user, the availability is 
obtained from the database using an application-specific 
protocol. In these scenarios, presence management is 

30 tied to particular software applications (e.g. AOL, 
Yahoo, MSN, and instant messaging products) . The 
applications establish presence, with some user control, 
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when the user logs in to an application. This method 
limits the information to the particular applications, 
and is not usable from outside the application for which 
it was designed. 
5 In today's applications, presence management usually 

requires an effort on the user's part. Normally, the 
user creates a profile to regulate presence management 
and to keep it current. Moreover, he or she must log 
into a device to initiate presence management monitoring. 
10 Finally, presence management is dependent upon a software 
application and/or device to which it is linked. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 Th e invention is pointed out with particularity in 

the appended claims. However, other features of the 
invention will become more apparent and the invention 
will be best understood by referring to the following 
detailed description in conjunction with the accompanying 
20 drawings in which: 

FIG. 1 is a schematic block diagram of an embodiment 
of a system to provide presence information; and 

FIG. 2 is a flow chart of an embodiment of a method 
of multimodal presence detection. 

25 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Briefly, embodiments of the present invention 
provide an improved presence detection method and system 
30 using a presence device which can be either attached to 
or embedded in various communication devices, including 
but not limited to a computer, a telephone and a personal 
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digital assistant (PDA). The presence device is operable 
in two or more modes. In an implicit mode, a user's 
presence — that is, an ability to view and respond to 
communications — is established with little or no effort 
on the user's part. In the implicit mode, the presence 
device is trained to authenticate the owner either from 
one or more fingerprints, using voice recognition, or 
another biometric technique. In an explicit mode, the 
user's presence is established using a log-in input, such 
as a password. 

When the user is authenticated as the owner, and if 
the communication device is set up to support the 
implicit mode, the user is questioned if the messages 
should be delivered to the device that is currently 
active. This may override preferences set in a user's 
profile . 

The presence device communicates with a presence 
management and detection Web service while establishing 
presence. The Web service may be polled by a routing 
system to facilitate real-time detection of available 
parties and their active devices, and dynamic selection 
of a desirable route to process messages. The desirable 
route may comprise either a near-optimal route, or in an 
exemplary embodiment, an optimal route to process a 
message faster and more efficiently. The herein- 
disclosed routing solution is well-suited for business 
applications . 

FIG. 1 is a schematic block diagram of an embodiment 
of a system to provide presence information. Consider a 
user 10 who accesses a telecommunication network 12 such 
as the Internet or another computer network. The user 10 
may access the telecommunication network 12 using either 



a telephone 13 via a telephone network 14 and a gateway 
16, a computing device such as a computer 20 running a 
software application 22, or a communication device 23 
having an associated presence device 24. For any of the 
aforementioned ways that the user 10 accesses the 
telecommunication network 12, information indicating the 
presence of the user is compiled and made available by a 
node 26 of the telecommunication network 12. The node 26 
may comprise a computer server 30 which provides a Web 
service 32 defined as a distributed service accessible 
over the telecommunication network 12 (e.g. the Internet) 
using ubiquitous protocols such as Simple Object Access 
Protocol (SOAP) and Extensible Markup Language (XML) over 
Hypertext Transfer Protocol (HTTP) . The computer server 
30 may comprise a JAVA™ 2 Platform Enterprise Edition 
(J2EE)/.NET application server, for example. 

This disclosure contemplates a multiplicity of users 
of the telecommunication network 12 whose presence 
information is compiled and made available using the Web 
service 32. For example, the Web service 32 may provide 
presence information for a user 34 having two associated 
devices 36 and 38, and a user 40 having an associated 
device 42. Examples of the devices 36, 38 and 42 
include, but are not limited to, those described in 
association with the user 10. 

The Web service 32 decouples presence information 
from a particular application, and makes the presence 
information available as a network function. Separating 
presence management as a component service available from 
the telecommunication network 12 facilitates flexibility 
both for users to publish their presence information and 
for consuming applications to consume the presence 



information. As a result, cross-application services are 
enabled. For example, indicating unavailability on a 
personal computer internet messaging (PC-IM) client can 
be interpreted as a user directive to the 
telecommunication network 12 to hold off cellular 
telephone calls and/or to take messages. 

The Web service 32 can be used in multiple 
applications, including but not limited to instant 
messaging, video conferencing, chat, business-to-business 
applications such as document routing for approval, and 
routing notifications to an appropriate device. The 
presence information may be published in multiple modes, 
including but not limited to a Web browser, a Voice XML 
application, a mobile telephone, and a specialized 
presence device. The presence information may be either 
explicitly updated by the user or implicitly handled by 
various devices and/or software applications. 

The presence information can be consumed by multiple 
devices, including but not limited to a Web browser, a 
mobile telephone, a personal computer, a personal digital 
assistant and a Web tablet. Independent of the actual 
presence information, the service may provide other 
information such as updatable and consumable user 
availability information 44, user/device profile and 
preference information 46, device status information and 
user location information. 

A routing system 50 intelligently routes messages 
and documents based on presence information provided by 
the Web service 32. An embodiment of a method performed 
using the Web service 32 and the routing system 50 is 
described with reference to FIG. 2. 

As indicated by block 60, the method comprises 



providing a presence device associated with a 
communication device. The presence device may be either 
embedded with the communication device or interfaced with 
and removable from the communication device. For 
purposes of illustration and example, the description of 
the method is made with reference to the presence device 
24 and the communication device 23 in FIG. 1. 

The presence device 24 is operable in a first mode 
and a second mode. The first mode may be referred to as 
either an implicit mode or a passive mode, and the second 
mode may be referred to as either an explicit mode or an 
active mode. 

If the presence device 24 is operating in the 
implicit mode, an act of biometrically authenticating the 
user 10 using the presence device 24 is performed as 
indicated by block 62. The presence device 24 comprises 
a biometric device to assist in performing the 
authentication. Examples of the biometric device 
include, but are not limited to, a voice authentication 
device and a fingerprint matching device. Optionally, 
the presence device 24 may have both voice authentication 
capability and fingerprint authentication capability. 

The voice authentication device may be embedded on a 
chip or a smart card, for example. Examples of voice 
authentication solutions include TESPAR™ from Domain 
Dynamics Limited and Voice Security Systems (VSS) . The 
VSS solution is able to verify a human voice in a few 
seconds on a fully self-contained 8 kB smart card running 
at 3.57 Mhz. For embedded voice authentication systems, 
a capture device is also used. 

The fingerprint authentication device may be 
embedded on a chip or a smart card, for example. 



Examples of fingerprint authentication solutions include 
FINGERCHIP™ from Atmel Corp. The FINGERCHIP™ device is a 
fingerprint scanner on a chip. Identicator Technology 
produces a package that, instead of creating an image of 
a fingerprint, creates a personal identification number 
(PIN) from the fingerprint. One fingerprint PIN uses 50 
bytes of storage for a one-to-one matching solution, or 
250 to 400 bytes for. a one-to-many match. In contrast, 
an image of a fingerprint may use up to 150 kB of 
storage. Regardless of the approach used, either a 
fingerprint image or a fingerprint PIN can be matched 
either with a copy internal to the presence device or, if 
relevant, a copy stored by the Web service 32. 

The type of authentication is suited to the type of 
communication device 23 to which the presence device is 
attached or embedded. For example, if the communication 
device 23 comprises a telephone (either wireless such as 
a cellular telephone, or wireline), the act of 
biometrically authenticating may comprise authenticating 
a voice of the user 10 during a call using the telephone. 
As the user 10 begins to talk on the telephone in a call 
between the user 10 and another party, his/her voice is 
authenticated. The user's voice is authenticated 
independent of the other party. The user 10 may be 
either a calling party or a called party of the call. 

If the communication device 23 comprises a computer, 
a personal digital assistant or another device having a 
keyboard, the act of biometrically authenticating the 
user 10 may comprise authenticating a fingerprint of the 
user 10 as the user types using the keyboard. The user's 
fingerprint is authenticated independent of a software 
application for which the user 10 is typing using the 



keyboard. 

Upon biometrically authenticating the user 10, the 
method may further require an act of receiving a presence 
confirmation input from the communication device 23, as 
indicated by block 64. An audible message or a visible 
message may be displayed by the communication device 23 
to prompt the user 10 to provide the presence 
confirmation input. •For example, the communication 
device 23 may include a visual display which displays a 
message such as "Confirm presence?". Alternatively, the 
communication device 23 may include a speaker or a like 
audio output device which audibly outputs a message such 
as "Confirm presence?". 

In response to the prompt, the user 10 may use an 
input device included in the communication device 23 
either to provide the presence confirmation input 
(indicating that the communication device is to be 
considered as active) or to provide an input indicating 
that the communication device 23 is not to be considered 
as active. For example, the presence confirmation input 
may comprise an affirmative input such as "Yes", "Y", 
"true" or another input indicating same. An input 
indicating that the communication device is not to be 
considered as active may comprise a negative input such 
as "No", "N", "false" or another input indicating same. 
The presence confirmation input may comprise one or more 
keystrokes of a keyboard or keypad, an input using a 
touchscreen, or a voice input using a microphone of the 
communication device 23. 

One or more signals associated with the biometric 
authentication and the presence confirmation are 
communicated from the communication device 23 to the Web 



service 32 via the telecommunication network 12. The one 
or more signals contains information identifying the user 
10 and the communication device 23. The Web service 32 
uses the aforementioned one or more signals to determine 
that the communication device 23 is to be considered as 
the active device for the user 10. 

If the presence device 24 is operating in the 
explicit mode, an act of receiving a user-entered log-in 
input from the communication device 23 is performed as 
indicated by block 66. The user-entered log-in input may 
comprise a password, personal identification code, or the 
like entered using the communication device 23. Either 
the log-in input or an indication that the log-in input 
authenticates the user is communicated from the 
communication device 23 to the Web service 32 via the 
telecommunication network 12. 

In response to the acts in blocks 62 and 64, or the 
act in block 66, the Web service 32 receives one or more 
authentication signals from the communication device 23. 
Upon accepting a signal, the Web service 32 updates a 
central presence database 68 to indicate that the 
communication device 23 is active for the user 10 (block 
70) . 

Using the aforementioned method, the presence of 
each user (10, 34 or 40) is detectable by the Web service 
32 either implictly or explicitly for a plurality of 
different communication devices. Further, the presence 
of the each user (10, 34 or 40) is detectable independent 
of whether the user logs in to a particular software 
application (e.g. an instant messaging application). 
Still further, the Web service 32 preferably provides 
presence information for a plurality of different 



software applications, one of which being a hereinafter- 
described routing application. 

As indicated by block 72, the routing system 50 
receives at least one message to be routed to the user 
10. The message may be received either before or after 
updating the central presence database 68 in block 70. 

As indicated by block 74, the routing system 50 
communicates with the central presence database 68 to 
determine which communication device is active for the 
user 10. The routing system 50 accesses the central 
presence database 68 via the Web service 32 and the 
telecommunication network 12. Continuing with the above 
example, the central presence database 68 communicates to 
the routing system 50 that the communication device 23 is 
active for the user 10. 

As indicated by block 76, the routing system 50 
sends the at least one message to the communication 
device 23. Optionally, the routing system 50 formats the 
presentation of each message based on the type of 
communication device which is active. The message may be 
coded in a markup language, such as XML for example. 

The aforementioned routing acts may be a component 
of various business applications, from supply chain 
management to procurement and billing. For example, 
after receiving a request that needs to be routed to a 
process owner, the routing system 50 contacts the Web 
service 32 to detect presence and active devices for 
those authorized to approve a request. If the routing 
system 50 is set up to operate in an automated mode, the 
availability of a main approver and his/her active device 
is checked. If the main approver is available, the 
request is routed to the main approver's active device. 



If the presence of the main approver is not detected and 
the time allocated for his/her approval expires, the 
presence Web service 32 is polled to detect presence "and 
active devices of secondary or alternative approvers. 
Consequently, the routing system 50 routes requests 
according to the rules set up in the presence-based 
routing applications. 

The herein-disclosed method and system allows 
organizations to speed up business processes involving 
mobile and distributed work force. Additionally, the 
presence-based routing system can be built to be 
application-independent to work with various business 
systems, in contrast to current routing systems which are 
applications-driven . 

A more specific example is given to further motivate 
use of embodiments of the herein-disclosed method and 
system. Consider the user 10 logging into the computer 
20 that is set up for accepting the passive mode for 
presence. As he/she begins typing, he/she is 
authenticated, and the computer 20 is considered as the 
active device for the user 10. Messages and 
notifications are thereafter routed to the computer 20. 
The user 10 reads three messages: a notice from a billing 
system that a bill is coming due, an invitation to start 
a video conference, and a notification about bad weather 
in the place where he/she plans to travel. 

The user's cellular telephone 13 then rings. The 
telephone 13 contains a presence card (not illustrated) . 
As the user 10 begins to talk after answering the call, 
he/she is authenticated as the owner. A message 
comprising "Confirm presence?" is played to the user 10. 
The user 10 presses the "#" key (the key for "No") and 



continues talking. The alerts continue to be delivered 
to the computer 20. 

After completing the call, the user 10 leaves 
his/her office to go to a meeting, taking his/her PDA 23 
with him/her. The PDA 23 also contains a presence device 
24. The user 10 touches a button on the PDA 23 and is 
authenticated. A message appears asking the user 10 if 
the PDA 23 is his/her active device. The user 10 presses 
Nv yes". Subsequent notifications are delivered to the PDA 
23. 

It is noted that the routing system 50 may comprise 
a computer system to perform the acts described herein. 
The computer system may be directed by computer-readable 
program code stored by a computer-readable medium. 
Similarly, the acts performed by the node 26 may be 
directed by computer-readable program code stored by a 
computer-readable medium. 

Several embodiments including preferred embodiments 
of a method and system for multimodal presence detection 
are disclosed herein. 

It will be apparent to those skilled in the art that 
the disclosed invention may be modified in numerous ways 
and may assume many embodiments other than the preferred 
form specifically set out and described above. 

Accordingly, it is intended by the appended claims 
to cover all modifications of the invention which fall 
within the true spirit and scope of the invention. 

What is claimed is: 
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